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Abstract: This paper extends Edgeworth-Cornish-Fisher expansions for the distribution 
and quantiles of nonparametric estimates in two ways. Firstly it allows observations to have 
different distributions. Secondly it allows the observations to be weighted in a predetermined 
way. The use of weighted estimates has a long history including applications to regression, 
rank statistics and Bayes theory. However asymptotic results have generally been only first 
order (the CLT and weak convergence) . We give third order asymptotics for the distribution 
and percentiles of any smooth functional of a weighted empirical distribution, thus allowing 
a considerable increase in accuracy over earlier CLT results. 

Consider independent non-identically distributed (non-iid) observations Xi n ,...,X nn 
in R s . Let F(x) be their weighted empirical distribution with weights W\ n , . . . ,w nn . We 
obtain cumulant expansions and hence Edgeworth-Cornish-Fisher expansions for T(F) for 
any smooth functional T(-) by extending the concepts of von Mises derivatives to signed 
measures of total measure 1. As an example we give the cumulant coefficients needed for 
Edgeworth-Cornish-Fisher expansions to 0(n _3//2 ) for the sample variance when observa- 
tions are non-iid. 

Keywords: Edgeworth-Cornish-Fisher expansions; von Mises derivatives; Weighted em- 
pirical distribution. 



1 Introduction and Summary 

Withers (1983, 1988) gave third order asymptotics for the distribution of functionals of 
empirical (or sample) distributions for iid observations. This paper extends these results to 
non-iid weighted observations. 

Traditional inference is based on the empirical distribution function. This gives each 
observation equal weight. However in many contexts it is more appropriate to weight the 
observations differently. An important class of weighted statistics are the rank statistics 
studied by Hajek and Sidak (1967). They gave first order (asymptotic) results both for 
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iid observations, and for the contiguous case where the observations are from distributions 
approaching the null case. However they did not deal with the case where observations 
have fixed distinct distributions. A seminal contribution to the theory of weighted empirical 
distributions was made by Koul (1992) who gave first order properties for linear models. 
This was extended by another seminal contribution, Koul (2002), to allow for random 
weights with applications to M- and R- estimates as well as to autoregressive processes. 
However, he confined his focus to first order (weak convergence) results. Optimality of 
certain weights in a Bayesian setting was proved by Chernoff and Zacks (1964) for testing 
the hypothesis of a jump in the mean. For other work, including a comprehensive account 
of the literature, we refer the readers to Lahiri (1992a, 1992b, 1992c) and Lahiri (2003). 

This paper - following on from Withers and Nadarajah (2008) - gives cumulant expan- 
sions - and hence Edgeworth-Cornish-Fisher expansions - for smooth functionals of weighted 
empirical distributions for arbitrary non-iid observations. These cumulant expansions are 
given in Section 2. As simple examples, Section 3 applies these results to the mean and 
variance. Section 4 gives a chain rule for the functional derivative of a function of several 
functionals, and uses this to obtain the leading cumulant coefficients for the Studentized 
mean, and the coefficient of variation. For completeness the Edgeworth-Cornish-Fisher 
expansions for the distribution and quantiles are given in Appendix A, as well as the mul- 
tivariate Edgeworth expansion. 

Let Xi n , . . . , X nn be independent random variables in R s with distributions Fi n , . . . , F nn . 
Let wi n , ■ ■ ■ j w nn be given real numbers adding to n: 

Win + • • • + w nn = n. (1.1) 

The simplest example giving more weight to the later observations are the weights Wi n = 
2i/(n + 1) shown by Chernoff and Zacks (1964) to be optimal in a Bayesian setting for 
testing for a jump in the mean. The mean with these weights was also used by Kander and 
Zacks (1966) and others. 

Define the weighted empirical distribution as 

n 

F(x) = n~ i y^w in I(X in < x) 
i=i 

for x in R s , where 1(A) = 1 or for A true or false. Its mean is 

n 

F(x) = E F(x) = n~ l WinFi n (x). (1.2) 

i=l 

F has moments 

/n 
x r dF(x) = n^ 1 Wi n m r (Fj n ), fj, r = jJL r {F) = Ep(X — mi) r 
i=i 

with sample versions 

n n 

fh r = m r (F) = n _1 ^ w in X\ n , % = fi r (F) = n~ l ^ w in (X in - fhi) r . 
i=l i=l 

For convenience we now suppress the subscript n and write Xi = Aj n , Fi = Fi n , Wi = W{ n . 
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Let T(G) be a smooth real functional denned for all signed measures G{x) on R s with 
total measure G(oo) = 1. (This is the condition that requires the constraint (jl.ip .) The rth 
order (von Mises) functional derivative of T(G) Tq(x\, . . . , x r ) for x\, . . . ,x r in R s may be 
defined just as in the case when F{x) is a probability distribution, and the von Mises- Taylor 
expansion for two such signed measures G, H remains valid, giving an iterative method for 
obtaining higher derivatives: 

oo 

T{G)-T{H) =J2T r (G,H)/r\, (1.3) 

r=l 

where 



T r {G,H) = 




, . . . , x r )dG(xi) . . . dG(x r ), 



where Th(x\, ... ,x r ) is made unique by two conditions: first that it is symmetric under 
permutation of arguments Xi, . . . ,x r ; and second that it satisfies 

jT F (x 1) ...,x r )dF(x 1 ) = Q (1.4) 

for r > 1. The first derivative, Tjj(x) is just the coefficient of e in the Taylor expansion 
of T(H + e(S x — H)) about e = 0, where S x is the distribution putting weight 1 at x. It 
is sometimes called the influence function of T(F). The rule for differentiating S(H) = 
Th{x\, . . . ,x r ) given by Theorem 2.1 of Withers (1983) remains valid: 

r 

T H (xi . . . X r+ i) = S H (x r +l) + {xi... Xr+l)i , (1.5) 

1=1 

where S(H) = Th{x\ . . . x r ) and (•)» means "drop the ith column". For example, putting 
r = 1, the second derivative is given by Th{x\X2) = Sh(x2)+Th{x2), where S(H) = Th{x{). 
The theory of statistical functionals was pioneered by von Mises (1947). The importance 
and use of the influence function has been widely used to obtain the asymptotic variance 
of general estimates, 

nvar(T(F)) -> J T F [xfdF[x) 

as n — > oo. The second derivative has been used to estimate and correct for bias: 

E T(F) - T(F) = n- 1 J T F (x, x)dF(x)/2 + 0(n~ 2 ). 

This was used by Jaeckel (1972) to justify the infinitesimal jackknife. However the use of 
other higher order derivatives has not been widespread. The reason for seems to be that not 
until Withers (1983), was the formula (|1.5jl available to compute higher order derivatives. 
Nevertheless their use since then has been disappointing. Perhaps this is due to a common 
misconception that for T(F) a function of moments, it is just as easy to simply use ordinary 
Taylor expansions. To see that this is not true, consider the following simple example. 

Example 1.1 Let us compute the asymptotic variance of the rth central sample moment, 
that is, d2i jn, by both the functional method and the ordinary Taylor expansion method, 
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(r — i)miin\ 

\ i / 

i=2 



r—i—X 



r—i 



when T(F) = \i r = J(x — fi) r dF(x), fi = mi{F), observations are iid, and the ordinary 
unweighted empirical distribution is used. Then 

T x = (x - n) r -fi r - r(x - n)n r -i, 

o 2 i = J T^dF(x) = fi 2r ~ l4 - 2// r -i/v + i + »" 2 /4-iM2- (1-6) 
The ordinary Taylor series method writes fj, r as a function of the non-central moments: 

Mr = Q-lf-Mmimr = (-l) r_ V - l)m\ + ^(-ir (") m^P = i(roi, • • • ,m r 

i=0 i=2 

say, with derivatives t.{ = dt(mi, ■ ■ ■ ,m r )/dmi given by 

U = (-irV - IJrmT 1 + E(- 1 ) M ( •) 
and for 1 < i < r, 

Also covar(mi(F),mj(F)) ?» (mi + j — mimj)/n. So, 

TTie challenge to these advocates of the ordinary Taylor method is to show that this reduces 
to (CQ|). .E^en /or i/ie variance, this takes some time. 

In Section 2 we use the von-Mises expansion for 6 = T(F) to obtain the basic cumulant 
expansion 

oo 

K r {0) = a r jn~i (1.7) 

j=r-l 

for r > 1 needed for the Edgeworth-Cornish expansions of Appendix A. (So, a2i/n and 
an/n are the asymptotic variance and bias of T(F), viewed as an estimator of T(F).) 
These expansions require that the cumulant coefficients {a r j} are all bounded as n — > oo. 
This is true if 

n 

W r = n^Y. w l ( L8 ) 
i=i 

is bounded for r > 1 and the functions of Section 2 are bounded. The expansions of 
Appendix A also require that 021 is bounded away from 0. Typically this is true if W% is 
bounded away from 0. The first order results of Koul (2002) may be reconciled with our 
first order results by noting that he works with d{ = wij (nW2 ) 1 ^ 2 . Throughout, we assume 
that all weights {wi n } are bounded and that all weight functions have finite derivatives. 
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2 Moment and Cumulant Expansions for Estimates 

What happens to non-parametric estimates when the assumption that observations come 
from the same distribution breaks down? Here we derive the cumulant expansion (jl.7p for 
6 = T(F), giving explicitly the cumulant coefficients of (jl.7p . 021, an, 032, 022, 043, needed 
for third order expansions and inference for non-iid observations. 

We follow the approach of Withers (1983) deriving the cumulant expansion from the 
moment expansion 

E{T(F)-T(F)Y= £ a' rj n^ 

j>r/2 

for r > 1 using the relations between their coefficients {a r j} and {a' r j} given in Theorem 
3.1 of Withers (1983). We use the following notation with F of (fT^jk 

T Xl ...x r — TpyXx, • • • ; %r)i 

[1\ = ET r Xi =j T^dF^), 

[l r ,H] t = ET r x T XiXi = jr xi T xlxl dF t { Xl ), 

[1M2 S ,2*].. = E md T r x T XtX T Xj = J j T^T^T^dF^dF^), 

[1,12% = E ind T x .T x . XjXj = J J ' T Xl T XlX2X2 dF i (x 1 )dF j (x 2 ), 
[1,2,3,123]^ = E md T Xi T Xj T Xk T XiXjXk 




T Xl T X2 T X3 T XlX2X3 dF i (x 1 )dF j (x 2 ) dF k (x 3 ) 



and so on, where E means E treating JQ, Xj, ■ ■ ■ as independent. Now set 

n 

[11 = n- 1 J>H1% 

i=l 

n 

[lMl]=n- 1 ^<+ 2 [11],, 

i=l 

n 

[V, 12 s , 2 4 ] = n- 2 f ' [ r > 12 '' 2 % ' 

and more generally for S" a number of sequences from and including 1, 2, . . . , r we set 

n n 

[5] = n-^...^^...^;[S],,., r , 

«i=l i r =l 

where Xj is the number of times j occurs in S. 

In Appendix B we derive the following expressions for the cumulant coefficients needed 
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for the Edgeworth-Cornish-Fisher expansions of T(F) to 0(n~ 3 / 2 ): 

Oio = T(F), a 2 i = {l 2 }, 
a n = {ll}/2 and a 32 = {l 3 } + 3{1, 2, 12}, 
a 22 = {1, 11} + {12 2 }/2 + {1,122}, 



(2.1) 
(2.2) 
(2.3) 

fl43 = {I 4 } - 3{1 2 , l 2 } + 12{1, 2 2 , 12} + 12{1, 2, 13, 23} + 4{1, 2, 3, 123}, (2.4) 



where 



{11} 
{1,2,12} 

{1,11} 
{12 2 } 
{1,122} 

{I 2 , 1 2 } 
{1,2 2 ,12} 



{1,2,13,23} 



i=i 

^ELi^Kfl^-WD, ifr = 2, 

" _1 £?=i «f{[l 3 ]i " 3[1],[1 2 ], + 2[1] 3 }, if r = 3, 

l^ 1 E"=i «*{[l 4 ]i " 4[1],[1 3 ]41 3 ], + 6[1] 2 [1 2 ], - 3[l]f}, if r = 4, 



[11] -n-^ufll^ = n-^t^dll]* - [12]«}, 
i=i i=i 

n 

n- 2 ^ «,?u,?([l,2,l% -2[1],[1,1% + [l]i[l]j[l%), 

n 

i=l 

n 

n- 2 X ™ 2 ™ 2 ([12 2 ]y - 2[12, 13]^ + [12]?,-), 

n 

n- 2 X ™ 2 w 2 ([l, 122],, - [1, 12%,- - [1]*[12% + [l] i [123] <ij -), 

n n 



n 



n 



L 2 ) 2 , 



i=i 

n 



X (I 1 - 22 ' " t 12 ]^ 1 ' " 2 ' 12 1 

+2[1] 2 [1,1%-[1]^), 
= [l 2 , 1% - [1 2 ],[1% - [1],[1, 1% + 2[1]J[1%, 



n 



X ^> 2 ([1, 2, 13, 2% fc - [l] fc [l, 12, 23} ljk 



-[l,l%[l,12] fej - + 2[l] fe [l%[l,l% - [l] 4 [l] fc [l%[12] jfc ), 



{1,2,3,123} = n~ 3 X 



2 2 2 
10 j U/j W 



■j(([l,2,3,12% fc -3[l] fc [l,2,12% J fc 



j,i,fc=i 

+3[%[i] fe [i,i2% fe - mi^iium^). 

In addition the following coefficient is useful for the calculation of the second order bias: 

012 = {lll}/6 + {1122}/8, (2.5) 
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where 

n 

{111} = n- 1 £ ^ ([HI]* " 3 [122] w + 2 [123]...) 
i=l 

and 

n 

{1122} = n" 2 ^ u,?^ ([1122] y - 2 [123%. + [1234]^.) . 

Typically 021 is bounded away from if and only if W 2 is bounded away from 0. 
For iid observations, (|2,ip - (|2.5p reduce to 

010 = T(F), 021 = [l 2 ] = W 2 [l 2 ]i, 

a n = [ll]/2 = W 2 [ll] 1 /2, 

a 32 = [1 3 ] + 3[1,2,12] =^ 3 [l 3 ]i + 3iy 2 2 [l,2,12] n , 

a 22 = [1, 11] + [12 2 ]/2+ [1,122] 

= W 3 [l, 11]! + W 2 2 [12 2 ]n/2 + W%[1, 122] n , 

a 43 = [1 4 ]-3W 4 [1 2 ] 2 + 12[1,12,2 2 ] + 12[1,2,23,31]+4[1,2,3,123] 

= W 4 { [l 4 ] x - 3 [l 2 ] 2 } + 12W 2 W 3 [1, 12, 2 2 ] n 

+4W|{3 [1, 2, 23, 31] 1U + [1, 2, 3, 123] m }, 

ai 2 = [111] /6+ [1122] /8 = W 3 [lll] 1 /6 + Wf [1122] n /8, 

where W,. is given by (|1.8|) . This follows from the above results and (|1.4|) . For w,- m = 1 
these reduce to the expressions of Theorem 3.1 of Withers (1983). 



3 Two Simple Examples 

If T(F) is a polynomial in F of degree r, (for example, fi r (F)), then derivatives of order 
greater than r are zero. Let us work through two simple examples: the mean and the 
variance. 

Example 3.1 Suppose that T(F) = fJ>(F) = [i say, and s = 1. Then T x = x — ju, and 
higher derivatives are zero. Then 

n 

a r>r -x = n" 1 WiK r (Xi) 

i=l 

and other cumulant coefficients are 0. If the observations are iid, then a r ^ T -\ = W r K r (X). 

Now suppose that {wi, Fi(x)} can be parameterised as Wi n = w(i/n), Fi n {x) = F(x,i/n) 
for some smooth functions w(t), F(x,t). That is, X; m has distribution GQu/ n \(x) say, and 
F(x,t) = Gqu\{x). Then we can write 

E X\ n = m r (i/n), where m r (t) = J x r F(dx,t), 

K r (Xi n ) = K r (i/n), where Ki(t) = mi(t), K 2 (i) = m 2 (i) — m(t) 2 , • • • 

n 

a r ,r-i = ^] k r (i/n), where k r (t) = w(t) r K r (t). (3.1) 
i=i 
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That is, m r (t) and n r (t) are the rth moment and cumulant of Gqm(x). By the Euler- 
McLaurin expansion (Abramowitz and Stegun, 1964, Equation (23.1.30), page 806), 



n oo 

n 



1 ^29(i/n) = ^2a k (g)n k , where 

i=l k=0 

"o(sO = / g(t)dt, 

Jo 

ai (g) = {g(l) - g(0)} /2, 

a k (g) = {^(1) " (fc-1) (O)} B k /k\ fork = 2,3,... 

and B k is the kth Bernoulli number, given by Abramowitz and Stegun (1964, P a 9 e $09, last 
column): B x = -1/2, B 2 = 1/6, B 3 = 0, B 4 = -1/30, • • • and B k = for k = 3, 5, 7, ■ ■ ■ . 
Applying this to g = k r of \3.1\) . we see that the rth cumulant of fJ-(F) satisfies the basic 
expansion ji.7] ) with the new coefficients a' r - = aj + i_ r (A; r ). So, the leading coefficients are 

a!^ r _ x = / k r (t)dt, a' rr = (k r (l) - k r (0))/2. 

In particular 



o 



'10 



f w{t)dt [ xF(dx,t), a' 21 = [ w{tf K 2 {t)dt. 
o J Jo 



So, for the unweighted case w(t) = 1, 



dt / xF{dx,t), a'21 = / K2(t)dt. 
J Jo 



Example 2.1.1 Suppose that Gq(x) = 1 — e x ' e on (0, 00), the scaled exponential distribu- 
tion. Then 

Kr (t) = (r - l)W{t) r , k r {t) = (r - l)\ri{ty, where r/(t) = w(t)0(t), 
a'={r-l)\ ! nitfdt, oJ T = (r-l)![7 ? (ir-»,(0r]/2. 



Jo 

So, to this degree of approximation, weighting the observations amounts to weighting the 
scale parameter, 9{t). 

Since fJ>(F) is linear in F, the last example did not need the machinery of functional 
differentiation. But as pointed out in Example 1.1, this is not the case for the next example, 
the variance. 

Example 3.2 Suppose that s = 1 and T(F) = H2{F) = fi 2 say. Then T x = fj^ — \i 2 , 
where \i x = x — fj,, T xy = —2fi x fi y , and higher derivatives are zero. We give the cumulant 
coefficients in terms of 



M* t ... =n- x Y j w k i » H ii si --- , (3.2) 



i=i 
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where fi r i = Efi r x . = E (JQ — fi) r . Since 

n 

i=i 

we have a 2 \ = {l 2 } = Mj - Mf 2 , {l 3 } = Mf - 3M| 4 + 2M 3 22 and {l 4 } = M 4 - 4M 2 4 6 + 
6M| 24 — 3M 2222 . ^4/so [ll]j = — 2E fi Xi = — 2/i 2 j, [12]jj = —2fiu^iij, so that 

a u = -Mf + Mf x . 

,4/sO = /U 2 j-/X 2; [l,12]y = -2(/X 3 j-/X2/Uli)/Xij ; [1,2,12]^ = -2(/X 3 j -/X 2 /ilj) (/i 3 j -fl2^lj ), 

giving {1, 2, 12} = -2(M| - M 2 2 ) 2 , so f/iai 

a 32 = M 6 3 - 3M 2 3 4 + 2M| 22 - 6(M| - M x 2 2 ) 2 . 

AZso {1, 11} = -2(M| - 2M? 3 - M| 2 + 2M 1 3 12 ), {12 2 } = 4(M| - M 2 X ) 2 , {1, 122} = 0, so 
that 

a 22 /2 = (Mf - M^) 2 - M| + M| 2 + 2Mf 3 - 2M 1 3 12 . 

Similarly writing {2.J$ as = b\ — 3b 2 + 12o 3 + I264 + 4&5, one obtains 

h = M 4 -4M 4 6 + 6M 4 24 - 3M 4 222 , 
b 2 = M 4 4 4 - 2M 4 24 + M 4 222 , 

b 3 = 2M 3 3 (-Mf + Mf 4 + M 2 3 3 - 4M 1 3 22 +/z 2 M 3 3 + 5/z 2 M 1 3 ) 

+2M 2 2 [2M 3 - M| 3 + 2M 3 22 - 3^ 2 (M 3 + M 3 2 ) + 3/^M 3 ] 
-2M 2 /i 2 [M 3 + M 3 4 - 2M 3 22 - 2/i 2 (M 3 + M 3 2 ) + S^M 3 ], 

64 = 4(M 2 -/i 2 M 2 )(M 2 -M 2 2 )(M 2 -M 2 1 ), 

b 5 = 0. 

Specialising to the iid case gives [i r i = /j, r , 

[l 2 ]i =IH~ /"2> = -2/^2, [l 3 ]i = A*6 - 3/U 2 /i 4 + 2// 2 , 

[l,2,12]u = -2 M |, [1,11]! = -2(^4-^), 

[12 2 ]n = 4/i|, [l 4 ]i = us- 4^ 2 /i 6 + 6/x 2 ^ 4 - 3/4, 

[1, 12, 2 2 ] n = -2/x 3 (^ 5 - 2/x 2 M3), [1, 2, 23, 31] m = 4/i 2/ x 2 , 

[1, 2, 3, 123] m = [1, 122]u = [111]! = [1122] n = 0, 

so that 

a-21 = W 2 (ha - fJ%), an = -W2H2, 
032 = W 3 (fJ,6-3fji 2 f H + 2t4)-6Wif4, 
a 22 = -2W 3 (/j 4 -fi 2 2 ) + 2Winl 

a 43 = Wiins - 4/i 2 // 6 + 6// 2/ U4 - 3// 2 - 3(/i 4 - // 2 ) 2 ] - 24W / 2 W / 3 /j 3 (/x 5 - 2/z 2 // 3 ) 
+48W 2 W1- 

For £/ie unweighted case, these cumulant coefficients {a r i}, reduce to those of Example 2 of 
Withers (1983). 
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4 A Chain Rule for More Complex Examples 



When T(F) is a function of moments (for example, the coefficient of variation or correlation), 
the following chain rule is very useful. 

Suppose that / : BP — > R is a smooth function and that S{F) is a smooth functional in 
BP. For 1 < a < p, let S a . xl ... Xr denote the rth derivatives of S a (F). Then by an extension 
of the chain rule for differentiating a function of a function, the first three derivatives of 
T(F) = /(5(F)) are 

T x = faSaxi T XlX2 = faS a . xlX2 + fabSa-xiS . X2 i 

3 

T XlX2X3 = faS a -xiX2X3 + fab ^ ] S a . Xl Sb- X2X3 + fabcSa-x\Sb. X2 S c . x . A , 

123 

where f a = f ai ---a r = d r f(s)/dsi ■ ■ ■ ds r \ s= s(F)i we use the tensor summation convention 
of implicit summation of pairs of a, 6, • • • , and ^123 sums over all 3 permutations of 1,2,3 
giving distinct terms. Set 



uf- = E S aXi S bXl ■■■ and M k {ab • • • , cd •••,•••) = n' 1 Yl ^t""?'" 

i=i 

Then 

[1], = f a uf, [l 2 ], = f a f h uf , 
[I 3 ], = fafbfc^, 
[H]i = fabvf 3 + faE SaXiXi, 
ll2h = fab^ + faE md S aXtXj , 

[1, 1% = f c {f ah vTv) + Za£ iW ScXiSaXiXj), 

[1, 2, 12]jj = fafb{fcd^i C ^Y + /c^™* SaXiSbXjScXiXj)- 



Set 



since 



Then 



C(a6) = viSax^Sbx.) = M\ab) - M 2 (a,6), 

n 3 

C(a6c) = n" 1 ^(S^, 5 6Xi , = M 3 (abc) - ^ M 3 (a6, c) + 2M 3 (o, 6, c) 

j=l abc 

3 
afec 

021 = fafbC(ab), 

n 

2a u = f ab C(ab) + / a n" 1 £ u, 2 (£ S aXiXi - E ind S aXiXj \ j=i ). 
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Also (Z32 is given by (|2.2p in terms of 
{I 3 } = fafbfcC(abc), 

n 

{1, 2, 12} = f a f b f c n~ 2 w 2 i w]E ind S aXtXj (S bXi S cXj - 2v b j S cX . + v\vj) 

+fafbfcd C(ad)C(bc). 
For the iid case these reduce to 

021 = W 2 f a hvt\ 

an = W 2 (f ab vf + / a £ S a xx)/2, 

a 32 = faf b fc(W 3 vf c + 3WiE md S aXlX2 S bXl S cX2 ) + 3f a f b f cd Wlvfv\ c . 

Example 4.1 Suppose that s = 1, p = 2, Si(F) = fi, 82(F) = ^2- After some simplifica- 
tion one obtains 

a 2 i = faf b C(ab) = ffC(U) + 2/ 1 / 2 C(12) + /|C(22), 

2an = f ab C(ab) - 2/ 2 C(ll) = (/ n - 2/ 2 )C(ll) + 2/ 12 C(12) + / 22 C(22), 

a 32 = {l 3 } + 3{l,2,12}, 

where 

{l 3 } = f?C(Ul) + 3/2/2(7(112) + 3/i/f C(122) + / 2 3 C(222), 
{1,2, 12} = D?(/ u - / 2 ) + 2D 1 D 2 f 12 + £>I/i2, = faC(ja). 

Also, in the notation of t3.2\) . C(ab), C(abc) reduce to 

C(ab) = M 2 a+b - M 2 b ; 

3 

C(abc) = M 2 a+b+c - Y, M 2 +b>c + 2M 2 aAc : 

abc 

C(lll) = Mf, C(112) = Ml - M| 2 - 2Mf 3 + 2M X 3 12 , 

C(122) = Mf - M? 4 - 2M| 3 + 2M 1 3 22 , C(222) = Mf - 3M 2 3 4 + 2M 2 3 22 . 

For i/ie iid case, 

C(ll) = W2M2, C(12) = W^3, C(22) = W 2 (/m - Ml), 

C(lll) = ^ 3 /U3, C(112) = W 3 (fH - i4), 

C(122) = W 3 {fi 5 - 2^ 2 /U 3 ), C(222) = W 3 {^ - 3^4 + 2/4). 

We now give two applications of this example, the Studentised mean and the coefficient 
of variation. Set a = o~(F) = [i^ 2 and A r = fi r /^ 2 - 

Example 4.2 The Studentized mean. Take s = 1, T(G) = [fi{G) - n{F)]/a(G). Then 
in terms ofC(ab), C(abc) of Example 2.4, 

T(F) = f 2 = fn = / 22 = 0, fx = a-\ f 12 = -o-- 3 /2, 
a 2 i = C(ll)/H2, a n = -o-~ 3 C(12)/2, 
a 32 = C(lll)^ 3 - 3C(ll)C(12)o-- 5 . 
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For the iid case, a 2 \ = W 2 , an = —W 2 Xs/2, a^ 2 = (W3 — 3W2) 2 A3- For the unweighted 
case, this gives a 2 \ = 1, an = — A3/2, 032 = — 2A3, in agreement with Withers (1989, 
Example 1.2, page 300). 



Example 4.3 The inverse of the coefficient of variation. Suppose that s = 1 and 
T(F) = ju/cr. Using the notation of the previous two examples, we obtain 

021 = C(ll)//x 2 - C(12)/i//X2 + C(22)^ 2 /4/ui, 
2an = (C(ll)/x - C(12))ct" 3 + 3C{22)na- 5 /4, 
a 32 = {1 3 } + 3{1,2,12}, 

w/iere 

{l 3 } = C(111)ct- 3 - 3C(112)^- 5 /2 + 3C(122) / u 2 a~ 7 /4 - C(222)// 3 o-- 9 /8, 

{1, 2, 12} = (D 2 lf i - D 1 D 2 )a- 3 + SDj/ia^/A, 

D 1 = [C(ll) - C(12)ii/2fi 2 ]o--\ D 2 = [C(12) - C(22)^/2 / u 2 ]^ _1 . 

For i/ie iid case, 

D 1 = W 2 aai, where a x = 1 - A 3 T(F)/2, 

D 2 = W 2 a 2 a 2 , where a 2 = A 3 - (A 4 - l)T(F)/2, 

and 

021 = W 2 [l - A 3 T(F) + (A 4 - l)T(F) 2 /4], 
2a u = ^ 2 [T(F)(l + 3A 4 )/4-A 3 ], 

{l 3 }/^ 3 = A 3 - 3T(F)(A 4 - l)/2 + 3T(F) 2 (A 5 - 2A 3 )/4 - T(F) 3 (A 6 - 3A 4 + 2)/8, 
{1, 2, 12}/^ 2 = a\T{F) - ai a 2 + 3a^T(F), 
a 32 = {l 3 } + 3{l,2,12}. 
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Appendix A: Edgeworth-Cornish-Fisher Expansions 



Since the cumulants of T(F) satisfy the expansion (jl.7p . it follows by Withers (1984) that 
its standardized version, Y n = n 1 /2 a21 1 / 2 { T ( j p) _ r (i?)}, has the Edgeworth-Cornish-Fisher 
expansions 

oo 

P n (x) = P(Y n < x) « - 4>{x) J2 K{x)n~ r / 2 , 

r=l 

oo 

P(\Y n \ <x)a 2$(x) - 1 - 2^(x) h 2r (x)n- r , 

r=l 

oo 

$- 1 (i'n(a:))«x-£;/ r ( a ;)n- r / 2 , 

r=l 

oo 

F- 1 (<I>(x))«x + ^< 7r (x)n- r / 2 , 

r=l 

where 3> and are the distribution and density of a unit normal random variable and 
{h r ,f r ,g r } are certain polynomials given by (4.1) of Withers (1984) in terms of the stan- 
dardized cumulant coefficients A r i = a 2 ^ 2 a r i. In terms of the Hermite polynomial Hei{x) = 
4>{x)^ l {—d/dx) l (f){x), the first few are given by 

hi = h = 9l = Mi + A 32 He 2 /6, 

h 2 = (A 2 U + A 22 )H ei /2 + {4A n A 32 + A i3 )He 3 /24 + A 2 32 He 5 /72, 
h 3 = A 12 + (A 3 1 + 3A u A 22 + A 33 )He 2 /6 

+(WA 2 n A 32 + 5A n A 43 + 10A 22 A 32 + A 54 )Hei/120 

+(2A n A 2 2 + A 32 A A3 )He 6 /U4 + A 32 He 8 /1296, 
f 2 ( x ) = (e 2 /2-£ 1 £ 3 /3)x + £ 4 (x 3 -3x)/24-^(4x 3 -7x)/36, 
h{x) = -e 2 £ 2 /2 + ej£ 3 /6-£ 2 e 3 (5x 2 -3)/\2- h£ A {x 2 -l)/8 

+£ 5 (x 4 - 6x 2 + 3)/120 + e^Ux 2 - 7)/36 - £ 3 £ 4 (llx 4 - 42x 2 + 15)/144 

+4(69x A - 187x 2 + 52)/648 + A X2 + A 33 (x 2 - l)/6, 
g 2 (x) = £ 2 x/2 + £ A {x 3 -3x)/24- 4(2x 3 -5x)/36, 
9s(x) = -£ 2 e 3 (x 2 -l)/6 + £ 5 (x 4 -6x 2 + 3)/120-£ 3 £ 4 (x 4 -5x 2 + 2)/24: 

+^(12x 4 - 53x 2 + 17)/324 + A 12 + A 33 {x 2 - l)/6, 

where l\ = An, £ 2 = A 22 , £ 3 = A 32 , £4 = A 43 and £5 = The coefficients given in §2 
give {h r ,f r ,g r ,l < r < 2} and so give the distribution and quantiles of Y n to 0(n -3 / 2 ). 
The same is true of its density, since we can write 

h r {x) = ~^2{h r iH ei{x) : r + i odd }, 
i=i 

so 

00 3r— 1 

P n {x) « - 5>" r/2 2 Ki{-d/dxf4>{x), 

r=l i=l 
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giving density 

oo 

p n (x) w 4>{x){\ + ^2n- r/2 h r (x)}, 

r=l 

where 

3r-l 

h r (x) = ^ {/t r jii"ej + i(x) : r + i odd}. 

So, 7^ = A n i7ei + A 32 He 3 /6, h 2 = (A 2 n + A 22 )He 2 /2 + (4A U A 32 + A 43 )tfe 4 /24 + 
A 2 2 HeQ /72, and so on. 

Suppose is ^-variate and the weights p-variate. Then the distribution and density 

of Y n = n 1 / 2 {T(i ? ) — T(F)} have the multivariate Edgeworth expansions for x in R q 

oo 

P n (x) = P(Y n < x) » ^n- r / 2 P r (-a/ax)$v-(x) 

r=0 

and 

oo 

p n (x) = (0/&n) . . . (d/dx q )P(Y n < x) ^Y, n ~ r ' 2 Pr{-d/dx)(p v {x), 

r=0 

where <J>y(x) and ^>y(x) are the distribution and density of 7V*(0, F), F = (a" ), 

= 1, 

= a'?t a + af 1 t a tpt 1 /6, 
h{t) = aft a tp/2 + af^t a t^t 5 /24 + P 4 (i) 2 , 

and so on, again using implicit summation over repeated pairs of indices. 
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Appendix B: Proofs for Section 2 

Here we derive the results of Section 2. By the von Mises expansion fjl .3|) and ()1.4|) . 

oo 

T(F)-T(F) = Y,T {r) /r\, 



r=l 



where T( r ) = T r (F,F) = O p (n r / 2 ) for T(.F) regular. We may express the moments of 
T(F) — T(F) in terms of ot r s... = E T^T^ . . . = 0(n~ u ), where v = R/2 for R even, 
v = (R+ l)/2 for i? odd and i? = r + s + . . .. Since 

T (r ) = n" r ^ w il ...w ir J ... J T xi „^ r d/ il i . . . d/^r, 

«l,...,i r =l 

where /j r = J(-Xj < x r ) — Fi(x r ), to simplify a^s... we need expressions for -Dji...r = 
£/ In . . . Ii r . Set 

Sij ... = I(i = j = ...), 

Sij...,kt~ = i(i=j = ...^k = e = ...), 

Sij t ke,mn = I(i = j,k = £,m = n all three distinct), 

and so on. Then 

E Ii\Ij2 = $ijDil2, 

E Iillj2h3 = <%fcAl23> 

3 

E Ii\Ij2lk?,Il4: = &i...tDil2M + %,fcl Al2-Dfc34 

3 

^ <%,HAl2-Dfc34 = &ij,klE)i\2F)^ + 5ik,j£F > il2,F > j2A + ^i£,jkDiuDj23, 

10 

E In . . . I m 5 = <5i...mAl...5 + %,fclm-Dil2-Dfc345) 

15 

E In . . . I n 6 = <^i...n Al...6 + $ij,k...n Al2-Dfc3456 
10 15 
+ ^ Sijk,£mn Al23-^456 + ^ &ij,kZ,mn Al2-Dfc34-Cm56 



for 



and and defined similarly. Setting Fj r = Fi{x r ) and i*aA2A... = i^(min(2;i, X2, •••))) 
we have 

Ai = 0, 

Al2 = ^ilA2 — FnFi2, 
3 

-Cjl23 = ^«1A2A3 — ^il-Fi2A3 + 2Fji-Fj2-^i3) 
123 

4 6 

Da.. .4 = i*ilA...A4 — ^il^i2A3A4 + -^l-^i2-^i3A4 — 3Fji . . . Fj4, 
1234 1234 
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and so on, where Y1T r ?i...r = ^fc summed over all m permutations of l...r giving 
distinct terms. So, writing T±___ r = T Xl ___ Xr , 

a\ = E T (1) = n~ x Yl Wi J TldDa = °' 

j 

a 2 = E r (2 ) = n~ 2 ^ t^w/, ^ ^ T^d-E / a ij 2 

u 

= n~ 2 Y,w 2 i j j T 12 dD il2 

i 

= n- 2 ^^ 2 {[H] i -[12] i J = n- 1 {ll}, 
a 3 = E T( 3 ) = n~ 3 ^ WiWjW k J J J T i22,dE Ialjzh3 

ijk 

= n~ 3 Y< w f J J jT 123 dD lU 3 = n- 2 {lll}, 

i 

a 4 = E T( 4 ) = rr A y^ y Wj...w e J ... J dE In...Iu 



o o 

n 04. i + 3n 04.2 



for 



and 



04.1 = n~ 1 Y, w t J ■■■ J T \..AdI)i\..A = 0(1) 



-2 



^wfu/ 2 . J - J T i..AdDi 12 dD k3 4, 



«4. 2 = n 

where sums over distinct in 1, . . . , n. So, 04.2 = a' 4 2 + 0(n _1 ), where 04 2 

replaces £^ fc by ^ ife . So, q 42 = {1122}. The expressions for aio,an,a\ 2 follow since 
a' u = an. Also 

E {T(F) - T(F)} 2 = a u + a 12 + a 13 /3 + a 22 /4 + 0(n~ 3 ), 

where 



< 1 , , - / , 2 ^ >>■''>:< j j T ± T 2 dE I a I j2 = n ' 2 Y, " : J J J ' / i ' / '-"//^i2 



1 n2i 



= n-{l 2 }, 



«i2 = n 3 



Y w i w j w k J J J T-iT 23 dE InI j2 I k3 

ijk 



n ~ 3 J2 w ij J J T 1 T 23 dD tl23 = n- 2 {1,11}, 

i 

"13 = n~ A y^/Wj...w e J ... J TiT 23i dE la... Iu = «i3.i + "13.2, 



a 22 — 022.1 + 022.2 
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for 



"13.1 = n~ A Yl W * J ■ ■ ■ j T l T 234dAl234 = 0(n" 3 ), 

"13.2 = n~ 4 w i w l j ■■■ f TiT 2U d(D il2 D ku ) = a' l32 + 0(n" 3 ), 

ik 

"22.1 = n ~ 4 ^2 w t J ■■■ J Ti2T 34 dD a ..A = 0(n- 3 ), 

i 

"22.2 = "22.21 + 2a 2 2.22 + 0(™~ 3 ), 

«22.2i = n^^w^w] I j T 12 T u d(D il2 D jU ) = n~ 2 {ll} 2 , 



"22.22 = "- 4 Y2 W i W j f j T 12 T 34d(Al3-Dj24) = n 2 {12 2 }, 

where a' 13 2 replaces J2ik by /Cjfc> so a 'i3 2 = ^~ 2 {1 5 122}. So, a 21 = {l 2 } and a' 22 
{1, 11} + {1, 122} + {ll} 2 /4 + {12 2 }/2. Now use a 2 i = a' 21 and a 22 = a' 22 - a 2 n . Also 



E {T(F) - T(F)} 3 = a m + 3a 112 /2 + 0(n~ 3 ), 



where 



"in = n 3 w i w J w k J J J T i T 2T?,dE InIj 2 I k 3 
J2 w i [ I I T!T 2 T 3 dD il23 = n- 2 {l 3 } 



n- 3 ' 



and 



"112 = n~^ Wi ...w e I ... I T x T 2 T M dE In... I e4 

i...e 

= "112.1 + "112.2 + 2an2.3 



for 



"112.1 = n 4 



"112.2 = n 4 



J> 4 / • • • / TiT 2 T 3 dD a ..A = 0(n- 3 ), 

i 

™Wj / • • • / T i T 2TMd{D ll2 D m ) 



n- 2 {l 2 }{ll} + 0(n- 3 ), 



"112.3 = n 4 



y . . . J r 1 r 2 r 34 d(Ai3 A24) 

n~ 2 {l, 2, 12} +0(n~ 3 ). 
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So, a 32 = {l 3 } + 3{l 2 }{ll}/2 + 3{1,2, 12}. Now use a 32 = a 32 - 3a 2 ia n to obtain a 32 
above. Also 

E {T(F) - T(F)} 4 = a im + 2a m2 + 2a m3 /3 + 3a n22 /2 + 0(n~ 4 ), 

aim = aiin.i + 3aim. 2 , 

aim = ani2.i + 3am 2 . 2 + 6qih 2 .3 + am2.4, 

ani3 = aiii 3 .i + 0(n~ 4 ), 

«H22 = an 22 .i + 0(n~ 4 ) 



for 



aim.i = n 



aim. 2 



ani2.2 



ani2.3 



ani2.4 



,-4 



-4 



Y. w t J ■■■ J TiT 2 T 3 T 4 dD 12U = n- 3 {l 4 }, 
£ y . . . y T x . . . T 4 d(D il2 D j34 ) 



am 2 .i = n 



n -2 {1 2 } 2_ n -3 {1 2 )l2}) 

5 ^ / • • • / T i T 2T 3 r 4 5dAi...5 = 0(n~ 4 ), 



— ^ \ 9 ^ 



■E- 

-3 ri2 



TiT 2 T 3 T 45 d(Dn 2 Dj 345 ) 



= n-^Hl, 11} + 0(n" 4 ), 



n 5 wfwf 

-3 ri n o2] 



TiT 2 T 3 T 45 d(Dn 4 Dj 235 ) 



= n~ 6 {l, 12, 2^} + 0(n" 4 ), 



' £ / • • • / T i T 2 T 3 T 4 5 d( D i45 D jl23 ) 



-3ri3 



= n- J {l d }{ll} + 0(n" 4 ), 



am 3 .i = n 



-6 



9ani3.2 + 6ani3.3 



— fi 2 2 2 

ani3.2 = n v 2_^ w i w j w k 

ijk 

= n~ 3 {l 2 }{l,122}, 

— 6 \ T 2 2 2 

ani3.3 = n 2^ w i w j w k 

ijk 

= ra~ 3 {l,2,3, 123}, 
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TiT 2 T 3 T4 5 Qd(Dii 2 Dj 34 D k5 Q) 



TiT 2 T 3 T 45 Qd(Dii 4 Dj 25 Dk3e) 
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— 6 2 2 2 

"1122.1 = n 2_^ W i W j W k 

ijk 

= ^" 3 (7i+ 472 + 873 + 274), 



TiT 2 T 34 T 56 d Dii 2 Dj 34 Dk56 
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where 



71 = n 3 > w^w^w 



ijk 

{1 2 }{11} 2 , 

3 



72 = n 



{11}{1,2,12}, 



73 = n 3 > w~w~w 



ijk 

{1,13,32,2}, 



74 = n 



£ u>? ^ / • • • / T i T ^MT^d{D %l2 D 3 ^D M% ) 

ijk 

{1 2 }{12 2 }. 



So, = 3{1 2 } 2 and a 43 = 043 + 4ana32 + 6a2ia' 22 for 043 as above. Now use 043 = 
a 43 - 4ana 32 - 6a 2 ia 22 . 

Note B.l An alternative method better for obtaining these expressions for the cumulant 
coefficients a r i, is to use the parametric approach of Withers (1988). This is possible since 

k(F(xi), . . . , F{x r )) = n 1 ~ r k(x\ . . . x r ), 

where 



k{x\ . . . x r ) = n 1 w[k{xi . . . x r Fi] 



and k(x± . . . x r F,j) = K,(I(Xi < x±), . . . , I(Xi < x r )). 
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